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Optically Variable Devices woftfo Encrypted Embedded Data for 
Authentication of Identification Documents 

Technical FieDd 

[01] The invention relates to authentication of documents, such as secure or 
5 identification documents, and particularly relates to the use of optically variable devices 
on such documents, including Optically Variable Devices with Encrypted Embedded 
Data for Authentication of Identification Documents. 

[02] Related Application Data 

10 [03] This application claims priority to the following United States Provisional 
Applications: 

- "Optically Variable Devices with Embedded Data for Authentication of Identification 
documents," Serial No. 60/459,284, Attorney Docket Number P0816D, inventor Robert 
Jones, filed March 31, 2003; 

1 5 - "Optically Variable Devices with Encrypted Embedded Data for Authentication of 
Identification Document," Serial No. 60/463,659, inventors Robert Jones and Leo Kenen, 
filed April 16, 2003; 

- "Uniquely Linking Security Elements in Identification Documents," Serial No. 
60/488,536, Attorney Docket Number P0853D, inventors Robert Durst, Robert Jones, 

20 and Leo Kenen, filed July 1 7, 2003; 

- "Hologram Manufacturing Method Employing Selective Placement of Refractive 
Materials," Serial No. 60/494,660, Attorney Docket Number P0865D, inventor Robert 
Jones, filed August 8, 2003; 

- "Methods and Devices for Providing Three Dimensional Bar Codes", Serial No. 

25 60/463,660, Attorney Docket Number P0824D, inventors Robert Jones and Brian Labrec, 
filed on April 16, 2003. 
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[04] This application is also related to the following U.S. patent applications and 
issued patents: 

- "Watermarking Holograms," Serial Number 09/74 1 ,779, inventors Stephen K. 
Decker, Hugh L. Brunk, and J. Scott Carr, filed December 21, 2000; 

5 - "Digitally Watermarking Holograms for Use With Smart Cards," Serial Number 
09/923,732, inventors Neil Lofgren, Stephen K. Decker, Hugh L. Brunk, and J. Scott 
Carr (now issued U.S. patent 660891 1, issued on August 19, 2003); 

- "Digital watermarks and methods for security documents," Patent Number 6345105, 
inventor Geoffrey B. Rhoads, issued February 5, 2002; 

1 0 - "Methods and systems for watermark processing of line art images," Patent Number 
6449377, inventor Geoffrey B. Rhoads, issued September 10, 2002' and 

"Identification Document," Patent Number 6066594, inventors Valerie E. Gunn and 
Janet Schaffher, issued May 23, 2000. 

1 5 [05] Each of the above U.S. Patent applications and issued patents is hereby 
incorporated by reference in its entirety. 

[06] Background and Sumimiairy 

[07] Digital watermarking is a process for modifying physical or electronic media to 
20 embed a machine-readable code into the media. The media may be modified such that 
the embedded code is imperceptible or nearly imperceptible to the user, yet may be 
detected through an automated detection process. Most commonly, digital watermarking 
is applied to media signals such as images, audio signals, and video signals. However, it 
may also be applied to other types of media objects, including documents (e.g., through 
25 line, word or character shifting), software, multi-dimensional graphics models, and 
surface textures of objects. 
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[08] Digital watermarking systems typically have two primary components: an 
encoder that embeds the watermark in a host media signal, and a decoder that detects and 
reads the embedded watermark from a signal suspected of containing a watermark (a 
suspect signal). The encoder embeds a watermark by altering the host media signal. The 
5 reading component analyzes a suspect signal to detect whether a watermark is present. In 
applications where the watermark encodes information, the reader extracts this 
information from the detected watermark. 

[09] Several particular watermarking techniques have been developed. The reader is 
presumed to be familiar with the literature in this field. Particular techniques for 
10 embedding and detecting imperceptible watermarks in media signals are detailed in co- 
pending application number 09/503,881 and U.S. Patent 5,862,260, each of which is 
incorporated by reference in its entirety. 

[10] Digital watermarks can be exploited in a variety of applications, including 
authenticating electronic and physical objects and counterfeit deterrence. They may also 
15 be used in conjunction with other security technologies. 

[11] Optically Variable Devices (OVDs) are another type of technology used in 
security applications. OVDs encompass a class of devices that includes Diffractive 
Optically Variable Image Devices (DOVIDs), such as holograms. Within the field of 
holography, there are a variety of types of DOVIDs including, for example, Exelgram™, 

20 Kinegram™, and Pixelgram™ DOVIDs. This document uses the term hologram to 
encompass many different devices but including at least diffractive devices, including 
DOVIDs manufactured on metallized or clear film, by the replication of a surface relief 
pattern (e.g., embossed hologram), through laser exposure (e.g., photopolymer 
holograms), or other known processes. The state of the art of manufacturing holograms 

25 offers several methods for creating a diffraction pattern and mass reproduction of them. 
The reader is presumed to be familiar with the various methods for creation of DOVIDS 
and other OVDs. 
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[12] Previous U.S. Patent applications 09/741,779 (Publication 2002-0080992), 
09/923,762 (Publication 2002-0080994), and 10/282,908 (Publication 20030128862), 
which are hereby incorporated by reference, describe how to embed auxiliary, machine- 
readable data in Optically Variable Devices (OVDs) such as holograms. One specific 
5 example is a digital watermark that carries hidden machine-readable data in a hologram. 
In addition, these documents describe that the OVD may be used on a secure document, 
and carry embedded data to authenticate the secure document, either by comparing the 
embedded data with other data on the document or with data in a database. 

[13] The machine readable data embedded in an OVD may be a laser readable 
10 structure such as a bar cqde like structure (e.g., approximately 1 by 5 mm area integrated 
into the graphic design of a KINEGRAM ® OVD by OVD Kinegram AG of Zug, 
Switzerland, which, when magnified appears like a one-dimensional bar code that is 
machine readable and carries around 64 bits of data). Alternatively, the machine readable 
data may be a digital watermark embedded and read using the methods described in the 
15 documents referenced above. 

[14] We have found that KINEGRAMS and other OVDs can be adapted to provide 
even further levels of document authentication. For example, we can embed the 
graphical image of an OVD such as a KINEGRAM with a digital watermark, where the 
watermark itself is readable using, for example, other digital watermarks embedded 
20 within other graphical elements on the identification document or using other machine 
readable information stored elsewhere in or on the identification document. This can link 
the OVD to other information on the identification document and make detection of fraud 
more apparent. 

[15] In a first aspect, this disclosure describes the use of OVDs on secure documents, 
25 and specifically a type of OVD called a KINEGRAM ® OVD that carries machine 

readable data. The KINEGRAM ® OVD carries laser readable data such as a bar code 
like structure integrated into the design and/or a digital watermark. For identification 
document applications such as ID cards, the auxiliary data embedded in the OVD 
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associates the OVD with the issuer of the identification document and/or to the 
identification document itself. 

[16] To authenticate the document, a scanner captures an image of the OVD, extracts 
the embedded data, and compares it with expected data (such as an issuer identifier) 
5 and/or other data on the document (e.g., ED card) to check that the document is valid and 
unaltered. The other data on the identification document may include printed text (e.g., 
scanned, OCR converted to text representation, and compared) digital watermarks 
embedded in background art and/or photos, bar codes, RF ID tags, integrated circuit 
chips, magnetic ink, magnetic stripe, etc. 

10 [17] The expected data may be fixed in the verification device or looked up in a local 
or remote database. The auxiliary data embedded in the identification document can be 
iised as an index to a database entry where the expected data associated with the issuer or 
the particular identification document is stored. 

[18] Biometric data verification may also be used to associate the bearer of the 
15 identification document with the document or information indexed in a database. The 
biometric data (or a hash of it) may be stored as auxiliary data embedded in the OVD or 
elsewhere in the identification document, and later extracted and compared with 
biometric data captured from the bearer or looked up from a database. 

[19] In a second aspect, the invention provides methods for integrating digital 
20 watermarks into holograms, watermarked hologram structures, and related applications. 
One aspect of the invention is a method of embedding a digital watermark in an optically 
variable device. This method creates a watermark image, and then embeds the 
watermark image into a holographic structure. Such a watermarked holographic structure 
can be used in connection with an information carrier, such as a smart card, credit card, 
25 integrated circuit card, RFED card, magnetic-stripe card, etc. The digital watermark 
caries information to assist in authenticating the card, the holograph and/or the card 
holder. 
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[20] In a third aspect, this disclosure describes adding an additional layer of security to 
either or both of the first and second aspects described herein by using encryption to 
transform the embedded information into encrypted embedded information, such that 
even if one could re-create the embedded information, one would not be able to create (or 
5 re-create) the correct embedded information without knowledge of the encryption keys. 
In an embodiment of this aspect, information on an identification document thus could be 
linked together using technology such as public key encryption technology. 

[21] In one embodiment, we provide an identification document comprising an OVD 
and a substrate. The OVD has embedded machine readable data, the embedded machine 

10 readable data encrypted with an encryption key. The substrate comprises one or more 

structures carrying data that is associated with the machine readable data embedded in the 
OVD. The OVD can comprise comprises at least one of a KINEGRAM and an embossed 
hologram, and the OVD can have an embedded digital watermark, which itself may carry 
an issuer identifier. The digital watermark can carry data that is related to other data on 

15 the document, and enables authentication of the document by comparison of the data in 
the digital watermark with other data on the document. This data related to the other data 
on the document can be encrypted with respect to other data on the document. 

[22] In one embodiment, we provide a method of providing security to an 
identification document having at least one storage element capable of storing 

20 information. An encryption key is provided, the encryption key comprising a public key 
and a private key. An optically variable device (OVD) in a machine readable format is 
created, the OVD associated with the public key. A payload of data is generated for 
storage in the storage element. At least a portion of the payload of data is encrypted with 
the private key, and the encrypted payload of data is transmitted to at least one location 

25 on the identification document. 

[23] At least a portion of the data payload can be based on data that is randomly 
selected from data stored in the storage element or that is encrypted from data that is 
stored in the storage element.. The storage element can comprise an optically variable 
device (OVD), optical storage media, hologram, KINEGRAM, Exelgram, Pixelgram, 
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three dimensional bar code, a two dimensional bar code, a magnetic stripe, and a chip. 
Transmitting the encrypted payload can comprise at least one of embedding, printing, and 
encoding encrypted data in at least one location on the identification document. The 
embedding can include, for example, digital watermarking. 

5 [24] In another aspect, we provide methods for verifying document such as an 

identification document. In one embodiment, we determine jurisdictional information 
related to the document, wherein the jurisdictional information is mathematically related 
to a digital watermark embedded in the document. We can use the jurisdictional 
information to extract the digital watermark embedded in the document. 

1 0 [25] In one embodiment, we verify a document by extracting a public key from a 
machine readable feature on the document, extracting a message payload from another 
machine readable feature on the document, the message payload being encrypted by a 
private key that forms part of a public-private key pair with the public key, and using the 
public key to de-scramble the message payload. 

1 5 [26] In another embodiment, we verify a document by determining jurisdictional 
information related to the document, wherein the jurisdictional information is used to 
obtain a watermark key which is related to a digital watermark embedded in the 
document and using the key to extract the digital watermark embedded in the document. 

[27] The foregoing and other features and advantages of the present invention will be 
20 even more readily apparent from the following Detailed Description, which proceeds 
with reference to the accompanying drawings and the claims. 



[28] Brief Description of the Drawings 

[29] The advantages, features, and aspects of embodiments of the invention will be 
25 more fully understood in conjunction with the following detailed description and 
accompanying drawings, wherein: 
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[30] FIG. 1 is an illustrative example of an identification document in accordance with 
an embodiment of the invention; 

[31] FIG. 2 illustrates an example of a cross-sectional view of the identification 
document of FIG. 1, taken along the A- A line, including an OVD security feature and 
5 printed ink used to carry other information, such as a photo, text and other security 
features; 

[32] FIG. 3 is a flowchart of a method for implementing encryption, such as public key 
encryption, into a KINEGRAM® and/or a KINEGRAM containing an embedded digital 
watermark; and 

10 [33] FIG. 4 is a flowchart of a method for applying a digital watermark to an image to 
be used in a KINEGRAM. 

[34] Of course, the drawings are not necessarily drawn to scale, with emphasis rather 
being placed upon illustrating the principles of the invention. In the drawings, like 
reference numbers indicate like elements or steps. Further, throughout this application, 
15 certain indicia, information, identification documents, data, etc., may be shown as having 
a particular cross sectional shape (e.g., rectangular) but that is provided by way of 
example and illustration only and is not limiting, nor is the shape intended to represent 
the actual resultant cross sectional shape that occurs during manufacturing of 
identification documents. 

20 

[35] Detailed Description 

[36] Terminology 

[37] In the foregoing discussion, the use of the word "ID document" "identification 
document" and/or "identification document" is broadly defined and intended to include 
25 all types of ID documents, including (but not limited to), documents, magnetic disks, 

credit cards, bank cards, phone cards, stored value cards, prepaid cards, smart cards (e.g., 
cards that include one more semiconductor chips, such as memory devices, 
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microprocessors, and microcontrollers), contact cards, contactless cards, proximity cards 
(e.g., radio frequency (RFDD) cards), passports, driver's licenses, network access cards, 
employee badges, debit cards, security cards, visas, immigration documentation, national 
ID cards, citizenship cards, social security cards, security badges, certificates, 
5 identification cards or documents, voter registration and/or identification cards, police ID 
cards, border crossing cards, security clearance badges and cards, legal instruments, gun 
permits, badges, gift certificates or cards, membership cards or badges, and tags. Also, 
the terms "document," "card," "badge" and "documentation" are used interchangeably 
throughout this patent application.). In at least some aspects of the invention, ID 
10 document can include any item of value (e.g., currency, bank notes, and checks) where 
authenticity of the item is important and/or where counterfeiting or fraud is an issue. 

[38] Further, in at least some embodiments, "identification" and "authentication" are 
intended to include (in addition to the conventional meanings of these words), functions 
such as recognition, information, decoration, and any other purpose for which an indicia 

15 can be placed upon an article in the article's raw, partially prepared, or final state. Also, 
instead of ID documents, the inventive techniques can be employed with product tags, 
product packaging, business cards, bags, charts, maps, labels, etc., etc., particularly those 
items including marking of an laminate or over-laminate structure. The term ID 
document thus is broadly defined herein to include these tags, labels, packaging, cards, 

20 etc. 

[39] "Personalization", "Personalized data" and "variable" data are used 
interchangeably herein, and refer at least to data, images, and information that are 
"personal to" or "specific to" a specific cardholder or group of cardholders. Personalized 
data can include data that is unique to a specific cardholder (such as biometric 
25 information, image information, serial numbers, Social Security Numbers, privileges a 
cardholder may have, etc.), but is not limited to unique data. Personalized data can 
include some data, such as birthdate, height, weight, eye color, address, etc., that are 
personal to a specific cardholder but not necessarily unique to that cardholder (for 
example, other cardholders might share the same personal data, such as birthdate). In at 
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least some embodiments of the invention, personal/variable data can include some fixed 
data, as well. For example, in at least some embodiments, personalized data refers to any 
data that is not pre-printed onto an ID document in advance, so such personalized data 
can include both data that is cardholder-specific as well as data that could be common to 
5 many cardholders. Variable data can, for example, be printed on an information-bearing 
layer of the ID card using thermal printing ribbons and thermal printheads. 

[40] As used herein, "printing" refers to any way to provide information to a 
document, including but not limited to printing using inks, dyes, and toners, as well as 
using laser engraving, laser etching, laser marking, etc. Virtually any printing method is 
10 usable, including but not limited to laser xerography, Indigo, offset printing, intaglio, 
laser engraving or marking, inkjet printing, thermal or mass transfer printing, dye 
diffusion thermal transfer ("D2T2") printing, (described in commonly assigned United 
States Patent No. 6066594, which is incorporated herein by reference in its entirety.), etc. 

[41] "Laminate" and "overlaminate" include (but are not limited to) film and sheet 
15 products. Laminates usable with at least some embodiments of the invention include 
those which contain substantially transparent polymers and/or substantially transparent 
adhesives, or which have substantially transparent polymers and/or substantially 
transparent adhesives as a part of their structure, e.g., as an extruded feature. Examples 
of potentially usable laminates include at least polyester, polycarbonate, polystyrene, 
20 cellulose ester, polyolefin, polysulfone, polyvinyl chloride (PVC), polyethylene, 

polypropylene, and polyamide. Laminates can be made using either an amorphous or 
biaxially oriented polymer as well. The laminate can comprise a plurality of separate 
laminate layers, for example a boundary layer and/or a film layer. Other possibly usable 
laminates include security laminates, such as a transparent laminate material with 
25 proprietary security technology features and processes, which protects documents of 

value from counterfeiting, data alteration, photo substitution, duplication (including color 
photocopying), and simulation by use of materials and technologies that are commonly 
available. Laminates also can include thermosetting materials, such as epoxy. Laminates 
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can include synthetic resin-impregnated or coated base materials composed of successive 
layers of material, bonded together via heat, pressure, and/or adhesive. 

[42] The material(s) from which a laminate is made may be transparent, but need not 
be. The degree of transparency of the laminate can, for example, be dictated by the 
5 information contained within the identification document, the particular colors arid/or 
security features used, etc. The thickness of the laminate layers is not critical, although in 
some embodiments it may be preferred that the thickness of a laminate layer be about 1- 
20 mils. Lamination of any laminate layer(s) to any other layer of material (e.g., a core 
layer) can be accomplished using any conventional lamination process, and such 

10 processes are well known to those skilled in the production of articles such as 

identification documents. Of course, the types and structures of the laminates described 
herein are provided only by way of example, those skilled in the art will appreciated that 
many different types of laminates are usable in accordance with the invention. Various 
lamination processes are disclosed in assignee's U.S. Patent Nos. 5,783,024, 6,007,660, 

15 6066594, and 6,159,327. Other lamination processes are disclosed, e.g., in U.S. patent 
Nos. 6,283,188 and 6,003,581. Each of these U.S. Patents is herein incorporated by 
reference. 

[43] For purposes of illustration, the following description will proceed with reference 
to ID document structures (such as TESLIN-core, multi-layered ID documents, 
20 polycarbonate core ED documents, etc.) and fused polycarbonate structures. It should be 
appreciated, however, that the present invention is not so limited. Indeed, as those skilled 
in the art will appreciate, the inventive techniques can be applied to many other structures 
formed in many different ways to provide secure information thereon. 

[44] FIGS 1 and 2 are illustrative straight on cross sectional and straight on views, 
25 respectively of an Identification document 8 in accordance with an embodiment of the 
invention. FIG. 1 illustrates an example of an Identification document, including an 
OVD security feature and printed ink used to carry other information, such as a photo, 
text and other security features, in accordance with one embodiment of the invention. In 
this example, the identification document is an identification card (which may or may not 
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include a photograph or other identification quality image of the card holder) comprising 
an OVD (e.g., a KINEGRAM ® OVD with embedded data), a substrate, ink that is 
printed on the substrate, and one or more layers of laminate covering the ink. The ink 
printed on the substrate carries text, a photo image, and possibly other security structures. 

5 [45] Referring to FIGS. 1 and 2, the identification document 8 can be formed using a 
core material 30 such as PVC, TESLIN, or polycarbonate (PC), and can be laminated 
with a substantially clear laminate 32. The identification document 8 can include, for 
example, a portrait of the cardholder 10, a ghost image 12, a two or three dimensional bar 
code 14, variable data such as a cardholder address and birthdate 16, a magnetic stripe 

10 (not shown in FIGs. 1 or 2 but often found on the rear side of an identification card) and 
an optically varying device (OVD) feature 18, such as a KINEGRAM ®. Note that the 
OVD 18 of FIG. 1 is shown as being on a part of the identification document such that it 
does not directly overlay variable information on the document, but the invention is not 
so limited. In at least one embodiment, for example, the location of the OVD 1 8 can 

15 coincide with at least some variable data on the card (e.g., data that can vary from user to 
use and/or from card to card, such as the portrait 10) in such a way as to protect against 
manipulation and/or alteration of the variable data (e.g., by swapping photos, altering 
demographic data, etc.) by methods such as intrusion or simulation. As those skilled in 
the art appreciate, OVDs can be substantially translucent or transparent, such that they 

20 can overlay data while permitting it to be visible.. 

[46] Any one or more of the images printed on the identification document 8 (e.g., 
portrait 10, ghost image 12) can be embedded with at least one type of a machine 
readable code, such as by one or more digital watermarks. The OVD can also be 
embedded with one or more digital watermarks. 

25 [47] The digital watermark may carry data, such as a key or document identifier that is 
either used to extract other data or compared with other data on the identification 
document. For example, the digital watermark in the OVD may carry a key that is 
necessary to decode another digital watermark embedded in an image printed on the 
document, such as a photo or background image. The digital watermark may carry 
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information, such as a bearer name or hash of bearer data, printed elsewhere on the card 
or carried in another machine readable feature, such as a digital watermark, magnetic 
stripe, RF ID, smart card, chip, 2D bar code, or 3D bar code (an example of the latter is 
described more folly in a commonly assigned application entitled "Methods and Devices 
5 for Providing Three Dimensional Bar Codes", Serial No. 60/463,660, inventors Robert 
Jones and Brian Labrec, filed on April 16, 2003, the contents of which are hereby 
incorporated by reference). 

[48] A digital watermark may carry virtually any type of information associated with a 
given identification document. This can be especially advantageous with new 

10 technologies for the creation of machine readable data. For example, consider 

technology such as a bar code containing embedded particles (e.g., nanoparticles), as 
described in an online article of NATURE magazine, dated October 30, 2003 and found 
at http://www.naturexom/nsu/03 1 027/03 1 027-7.html . In this technology, each barcode 
line contains atoms of permalloy (an iron-nickel mixture), where the printed lines 

1 5 arranges these magnetic particles in unique patterns, each pattern having a measurable, 
unique magnetic field. This nanoparticle material can be used on areas such as the 
barcodes of identification documents (or on other parts of the identification document) 
and a quantitative measurement of the unique magnetic pattern can be taken and encoded 
as a machine readable signature. For example, the nanoparticle material can be used as a 

20 coating on all or part of an identification document, creating a unique machine readable 
magnetic signature that can then can be stored in a data carrier on the identification 
document itself (e.g., encoded into. a KINEGRAM, stored on a smart card chip, encoded 
into a digital watermark, stored in an external database, etc.), and encrypted, if desired. 
Later, during authentication, the unique machine readable magnetic signature information 

25 stored about the nanoparticle material can be retrieved and compared with a reading from 
the location(s) of the actual nanoparticle material, to check the authenticity of the 
identification document. 
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[49] With any of the above described systems, if the relationship between the cross- 
referenced data on the identification document is broken, either by tampering the OVD or 
other data, an automatic verification detects this tampering by finding a mismatch in the 
data or being unable to extract the embedded data. 

5 [50] In at least some embodiments, the identity card is constructed such that attempts 
to remove and substitute or alter the OVD and other structures in the card result in 
damage of the OVD and/or the structures. For example, by making the OVD and/or 
other structures fragile to this type of tampering, such as by using tamper evident inks 
and/or adhesives, the validity of the card can be checked by examining the OVD and/or 

10 structures for visible signs of destruction, and by attempting to read the embedded data, 
such as laser readable or watermark in these structures automatically. If the OVD or 
printed structures are altered, automatic reading of embedded data will fail, indicating 
that the card is invalid. This effect may be accomplished by choosing an adhesive or set 
of adhesives that bonds the OVD and ink to the laminate and substrate such that the OVD 

15 and ink break apart as shown in Fig. 1 if the laminate and substrate are separated. For 
more information on this approach, see U.S. Patent 5,380,695, and co-pending 
application 10/329,315, which are hereby incorporated by reference. 

[51] In another embodiment of the invention, the OVD comprises a Kinegram with a 
digital watermark (or other machine readable technology) containing at least a portion of 
20 a public key necessary for reading data contained elsewhere on the identification 
document, such as data contained in a digital watermark of a photo, 2D/3D barcode, 
smart card, chip, RFID (RF Identification), OCR (optical character recognition), 
biometric feature (e.g., fingerprint), etc., or containing other machine readable data on the 
card. 

25 [52] FIG. 3 is a flowchart of a first method for implementing encryption, such as 
public key encryption, into a KINEGRAM® and/or a KINEGRAM containing an 
embedded digital watermark. For purposes of illustration only, the following discussion 
will proceed using the example of an identification document that is a card issued by an 
issuing organization, where the identification document includes variable information and 
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preferably includes a portrait of the cardholder (examples of such documents include 
driver's licenses, national identification cards, voter identification cards, and the like). Of 
course, those skilled in the art will appreciate that the invention has application to many 
other types of identification documents and other documents. 

5 [53] Referring again to FIG. 3, a Public Key and Private Key pair is generated (step 
100). The Public/Private key pair can, for example, be used for a particular jurisdiction 
or set of jurisdictions for a known period of time. 

[54] Using the Public/Private key pair (step 1 10), a Kinegram in a machine readable 
format is created (step 120). The Kinegram has all or all or part of the Public Key 
10 necessary for reading the data to be embedded. 

[55] The private key is retained (step 130) to encode the data. The ID card is created 
(step 140) through any method known in the art, and is personalized (step 1 50). During 
card personalization, the data payload that is intended for storage in the machine readable 
portions of the card is generated (step 160). For example, in one embodiment, during 
15 card personalization the payload that is intended for storage in a digital watermarked 

portrait is generated, as well as payloads intended for storage in other digital watermarks 
that may be on a card. In one embodiment, during card personalization the payload 
intended for storage in another data storing element of the ID card, such as a 2D/3D 
barcode, chip, RFID, magnetic stripe, etc., also can be generated in step 160. 

20 [56] At least a portion of the data payload is encrypted using the Private key (step 

170). In at least one embodiment, a significant portion of the data payload is encrypted 
using the Private key. In at least one embodiment, if the data payload is small, the entire 
payload is encrypted using the Private key. 

[57] The encrypted data is then embedded, printed, or encoded in one or more 
25 locations on the ID document (step 180). In at least one embodiment, the non-encrypted 
data is also embedded, printed, or encoded into one or more locations on the ID 
document, as well. 
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[58] In one embodiment, the encrypted data can be embedded into an OVD on the 
identification document by embedding a digital watermark into the OVD. FIG. 4 is a 
generalized method for embedding a digital watermark (DWM) into a KINEGRAM, but 
those skilled in the art will appreciate that this embedding method is applicable to many 
5 other types of OVDS and can be adapted to work with virtually any storage element or 
device. Referring to FIG. 4, the basic artwork for the given KINEGRAM is received 
(step 300). This art can be in virtually any format, e.g., vector artwork, raster artwork, 
bitmap artwork, etc. The art is converted to a bitmap image (if it is not a bitmap image 
already) (step 310). As those skilled in the art appreciate, the required resolution of the 
10 bitmap image can depend, at least in part, on the specific technique that is used in step 
320 for digitally watermarking the image. And, furthermore, the specific technique for 
digitally watermarking the bitmapped image (step 320) can depend at least partially on 
the type of art of the original image (step 300). 

[59] For example, some KINEGRAM images are based on an original vector image 
15 having artwork consisting of many fine lines. Such an image can be digitally 

watermarked using, for example, systems and methods described in the following 
commonly assigned patents, each of which is incorporated by reference. "Digital 
watermarks and methods for security documents," Patent Number 6345105, inventor 
Geoffrey B. Rhoads, issued February 5, 2002, and "Methods and systems for watermark 
20 processing of line art images," Patent Number 6449377, inventor Geoffrey B. Rhoads, 
issued September 10, 2002. 

[60] Referring again to FIG. 4, the digitally watermarked bitmap image is then ready 
to be embedded into the KINEGRAM or other OVD or storage element (step 330). 
Systems and methods for embedding DWM images into OVDs such as KINEGRAMS 
25 are described further in the following commonly assigned patents and applications, each 
of which is hereby incorporated by reference: "Watermarking Holograms," Serial 
Number 09/741,779, inventors Stephen K. Decker, Hugh L. Brunk, and J. Scott Carr, 
filed December 21, 2000, and "Digitally Watermarking Holograms for Use With Smart 
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Cards " Serial Number 09/923,732, inventors Neil Lofgren, Stephen K. Decker, Hugh L. 
Brunk, and J. Scott Carr (now issued U.S. patent 660891 1, issued on August 19, 2003). 

[61] In at least one embodiment of the invention, for identification documents 
containing information storing elements such as 2D/3D barcodes, chips, etc. (step 190), 
5 the security of the system may be increased by selecting encrypted or random data from 
the information storing element and using that encrypted or random data in the machine 
readable technology, such as the digital watermark (step 200). For example, in one 
embodiment, data in a digital watermark that is associated with variable data is based on 
encrypted or random data from a 2D/3D barcode, magnetic stripe, or chip. In one 
10 embodiment, the encrypted or random data can be digitally signed using an algorithm 
such as the standard DSA algorithm. 

[62] Of course, alternative implementations of the invention can use other types of 
data in the KINEGRAM to tie this data to other data storage areas on the identification 
document and/or other digital watermarks on the card. In accordance with embodiments 
15 of the invention, there are a variety of ways of using encryption or a similar 
randomization process to tie data in security elements together. 

[63] For example, in one embodiment, all or part of the public key for one data- 
carrying element is embedded in another data carrying element (e.g., digital watermark, 
smart card, laser readable media, machine readable optically variable device, bar code, 
20 magnetic stripe, etc.). 

[64] In another exemplary embodiment, random data (e.g., purely random or pseudo 
random data generated by a pseudo random number generator seeded by a key) is XOR'd 
or otherwise mathematically combined with data carried in one security element to 
produce data encoded in another security element, 

25 [65] In a further embodiment, jurisdiction data (e.g., data associated with an issuer of 
an identification document) is mathematically combined with or stored in/with data in 
one security element is encoded in another security element. 
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[66] In a third aspect of the invention, the implementation of the second aspect of the 
invention is part of an identification system having a plurality of different Kinegram 
"masters", each Kinegram master associated with different machine readable codes (e.g., 
digital watermarks) containing different keys. In this aspect, it is possible to use different 
5 Kinegram on cards, (including randomly) where the Kinegram machine readable 

technology (e.g., digital watermark) is known to match the machine readable technology 
(e.g., watermark) in the some variable data (e.g., the portrait) on an identification 
document. This can add security because it can limit the chance that a substituted or 
bogus Kinegram can provide a usable key for reading the machine readable data (e.g., 
10 digital watermark). 

[67] In an alternative implementation of the invention, jurisdictional information is 
used as a digital watermarking key, instead of an encryption key, to help decode a digital 
watermark. A watermark key in this context reveals some secret about a watermark or 
watermark embedding or decoding process. For example, the key reveals information 

15 about a watermarking protocol, a watermark embedding/decoding characteristic and/or a 
watermark payload encryption key. In one implementation a key provides a pseudo- 
random sequence that is used to embed the watermark. In another example, a key 
specifies locations for watermark embedding, host signal features to be modified to effect 
embedding, and/or semantic meaning of particular features (e.g., how modifications to 

20 the host signal are mapped to particular data symbols, such as binary or M-ary symbols), 
etc., etc. The jurisdictional information can be used as an index to locate an appropriate 
key. Or the jurisdictional information can be combined with other data to form a key. 
Still further, the jurisdictional information itself can be used as a watermarking key. 

[68] Another example is to link machine-readable information from another data 
25 carrying area of the identification document, such as a smart card chip, optical media, or 
laser engraved area, to help decode a digital watermark. In one implementation we 
provide a reader which images the card to capture both the laser engraved area and an 
area including a digital watermark. (Sometimes these areas overlap, or a digital 
watermark is provided through the laser engraving.) The reader preferably captures the 
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laser engraved area and the digitally watermarked area using a single optical scanner, but 
the present invention is not so limited. The machine-readable information of the laser 
engraved area includes a watermark key (or encryption key), which is used to decode the 
watermark (or to be paired with, e.g., a public key for decrypting auxiliary information). 
5 The curious reader is referred to US Patent Application Nos. 10/330,033 and 60/456,677, 
which are each herein incorporated by reference, for related methods and/or 
environments. 

[69] Instead of laser engraving, an optical memory card, like that provided by 
LaserCard Systems Corporation, headquartered in Mountain View, CA (e.g., via their 

10 LaserCard and LaserCard 600-Q Optical Card Drive) can be used to provide machine- 
readable information, which can carry a key to decode, decrypt or help find a digital 
watermark. (LaserCard 's promotional material suggests that its optical memory card 
contains a reflective optical recording medium sandwiched between transparent, 
protective layers. Information is stored n the card as a binary code, where ones and zeros 

1 5 are represented by either the presence or absence of physical "spots" on the recording 
media. The spots are tiny — as small as 2.25 microns.) In some case we align an 
imagining sensor so that both optically recorded information and a digital watermark can 
be read by the same imagining sensor. 

[70] The usefulness of these and other embodiments of the invention can be further 
20 understood by imagining the following scenarios. 

[71] First, suppose that a Kinegram were taken from one real/authentic card and put 
into another. In that instance, the counterfeit attempt should fail. In this example, using 
information and embodiments of the invention described herein, the counterfeit will not 
be created using the Private Key necessary for creating readable data. If the variable data 
25 (e.g., photo) were taken from a real identification document and the machine readable 
technology (e.g., digital watermark) in the variable data does not contain data from the 
data storing element on the identification document (e.g., 2D/3D barcode or chip), then it 
would still match the Kinegram since they are both the same as the original. However, 
variable data (e.g., a portrait) printed by the counterfeiter would not work. Since the 
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Kinegram is real in this case it will only match a photo copied from a real document, the 
data encoded in the photo will not be alterable. 

[72] Next, suppose that a Kinegram were stolen - then used to make a counterfeit card. 
In that instance, as well, the counterfeit attempt should fail. In this example, using the 
5 information and embodiments of the invention described herein, the counterfeiter would 
still need to generate variable data (e.g., a photo) with the machine readable code (e.g., 
digital watermark) matching the Kinegram and possibly another data storing element 
(e.g., 2D/3D Barcode, magnetic stripe, chip) with the correct encrypted data. Lack of 
knowledge of the private key would make generating useful data nearly impossible. If 
10 three major data elements are tied together using a full DSA certificate then it could be 
. impossible to alter or swap any one of the elements without knowledge of the Private 
(secret) key. 

[73] Next, assume that a counterfeit Kinegram was used to create a counterfeit license. 
In this example, using the information and embodiments of the invention described 

15 herein, the counterfeit attempt should fail even with a so-called "really convincing" 

bogus or fake Kinegram. In accordance with at least some embodiments of the invention 
described herein, a counterfeit Kinegram should be impossible due to the lack of 
knowledge of the keys necessary to embed the machine readable technology (e.g., digital 
watermark) containing the read key for the document itself. If the key in the Kinegram 

20 were not readable, it would be a clear indication of the counterfeit. 

[74] For more information about the application of OVDs, and specifically 
KINEGRAM ® OVDs, with embedded data for authentication of identification 
documents, see Appendix A, entitled "Information Response AAMVA Unique Identifier 
Response," by Digimarc ID Systems, which is hereby incorporated by reference. 

25 [75] Of course, in all of the examples and embodiments described herein, the substrate 
and/or laminate of the identification document may be made of many different types of 
materials, including but not limited to resins, polyesters, polycarbonates, vinyls, 
acrylates, urethanes, and cellulose based materials, thermosetting material, thermoplastic, 
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polymer, copolymer, polycarbonate, fused polycarbonate, polyester, amorphous 
polyester, polyolefin, silicon-filled polyolefin, TESLIN, TYVEC, plastic paper, paper, 
synthetic paper, foamed polypropylene film, polyvinyl chloride, polyethylene, 
thermoplastic resins, engineering thermoplastic, polyurethane, polyamide, polystyrene, 
5 expanded polypropylene, polypropylene, acrylonitrile butadiene styrene (ABS), ABS/PC, 
high impact polystyrene, polyethylene terephthalate (PET), PET-G, PET-F, polybutylene 
terephthalate PBT), acetal copolymer (POM), polyetherimide (PEI), polyacrylate, poly(4- 
vinylpyridine, polyvinyl acetate), polyacrylonitrile, polymeric liquid crystal resin, 
polysulfone, polyether nitride, and polycaprolactone. 

10 [76] One source for OVDs suitable for this application is OVD Kinegram AG, a 

member of the Kurz Group. Other types of embossed OVDs may be used as well if they 
meet the design constraints for the particular secure document application. 
Advantageously, the OVD should have a high index of refraction. It may be transparent, 
but need not be. 

15 [77] Concluding Remarks 

[78] Having described and illustrated the principles of the technology with reference to 
specific implementations, it will be recognized that the technology can be implemented in 
many other, different, forms. To provide a comprehensive disclosure without unduly 
lengthening the specification, applicants incorporate by reference the patents and patent 
20 applications referenced above. 

[79] The methods, processes, and systems described above may be implemented in 
hardware, software or a combination of hardware and software. For example, the 
auxiliary data embedding processes may be implemented in a programmable computer or 
a special purpose digital circuit. Similarly, auxiliary data reading and authentication 
25 using other data on an identification document may be implemented in software, 

firmware, hardware, or combinations of software, firmware and hardware. The methods 
and processes described above may be implemented in programs executed from a 
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system's memory (a computer readable medium, such as an electronic, optical or 
magnetic storage device). 

[80] The technology disclosed herein can be used in combination with other 
technologies. Also, instead of ID documents, the inventive techniques can be employed 
5 with product tags, product packaging, labels, business cards, bags, charts, smart cards, 
maps, labels, etc., etc. The term ID document is broadly defined herein to include these 
tags, maps, labels, packaging, cards, etc. 

[81] It should be appreciated that while FIGs. 1 and 2 illustrate a particular species of 
ID document — a driver's license — the present invention is not so limited. Indeed our 

10 inventive methods and techniques apply generally to all identification documents defined 
above. Moreover, our techniques are applicable to non-ID documents, e.g., such as 
printing or forming covert images on physical objects, papers, currency, checks, etc. 
Further, instead of ID documents, the inventive techniques can be employed with product 
tags, product packaging, business cards, bags, charts, maps, labels, etc., etc., particularly 

1 5 those items including providing a non-visible indicia, such as an image information on an 
over-laminate structure. The term ED document is broadly defined herein to include these 
tags, labels, packaging, cards, etc. In addition, while some of the examples above are 
disclosed with specific core components, it is noted that-laminates can be sensitized for 
use with other core components. For example, it is contemplated that aspects of the 

20 invention may have applicability for articles and devices such as compact disks, 

consumer products, knobs, keyboards, electronic components, decorative or ornamental 
articles, promotional items, currency, bank notes, checks, etc., or any other suitable items 
or articles that may record information, images, and/or other data, which may be 
associated with a function and/or an object or other entity to be identified. 

25 [82] The technology and solutions disclosed herein have made use of elements and 
techniques known from the cited documents. Other elements and techniques from the 
cited documents can similarly be combined to yield further implementations within the 
scope of the present invention. Thus, for example, single-bit watermarking can be 
substituted for multi-bit watermarking, technology described as using imperceptible 
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watermarks or encoding can alternatively be practiced using visible watermarks (glyphs, 
etc.) or other encoding, local scaling of watermark energy can be provided to enhance 
watermark signal-to-noise ratio without increasing human perceptibility, various filtering 
operations can be employed to serve the functions explained in the prior art, watermarks 
5 can include subliminal graticules to aid in image re-registration, encoding may proceed at 
the granularity of a single pixel (or DCT coefficient), or may similarly treat adjoining 
groups of pixels (or DCT coefficients), the encoding can be optimized to withstand 
expected forms of content corruption, etc. Thus, the exemplary embodiments are only 
selected samples of the solutions available by combining the teachings referenced above. 

10 The other solutions necessarily are not exhaustively described herein, but are fairly 

within the understanding of an artisan given the foregoing disclosure and familiarity with 
the cited art. The particular combinations of elements and features in the above-detailed 
embodiments are exemplary only; the interchanging and substitution of these teachings 
with other teachings in this and the incorporated-by-reference patent documents are also 

15 expressly contemplated. 

[83] The particular combinations of elements and features in the above-detailed 
embodiments are exemplary only; the interchanging and substitution of these teachings 
with other teachings in this and the incorporated-by-reference patents/applications are 
also contemplated. 



20 



